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Abstract 

In this paper, we improve and complete the theoretical results of the kernel-based approx- 
imation (collocation) method for solving the high-dimensional stochastic partial differential 
equations (SPDEs) given in our previous papers. According to the extended theorems, we 
can use more general positive definite kernels to construct the kernel-based estimators to ap- 
proximate the numerical solutions of the SPDEs. Because a paraboUc SPDE driven by Levy 
noises can be discretized into serval elliptic SPDEs by the implicit Euler scheme at time. We 
mainly focus on how to solve a system of elliptic SPDEs driven by various kinds of right-hand- 
side random noises. The kernel-based approximate solution of the elliptic SPDEs is a linear 
combination of the positive definite kernel with the differential and boundary operators of the 
SPDEs centered at the chosen collocation points, and its random coefficients are obtained by 
solving a system of random linear equations, whose random parts are simulated by the elliptic 
SPDEs. Moreover, we introduce the error bounds - confident intervals - of the kernel-based 
approximate solutions of the elliptic (parabolic) SPDEs in terms of fill distances (or possible 
time distances) in the probabihty sense. We also give a well coding algorithm to compute the 
kernel-based solutions of the second-order parabolic SPDEs driven by time and space Poisson 
noises. The two-dimensional numerical experiments show that the approximate probability dis- 
tributions of the kernel-based solutions are well-behave for the Sobolev-spUne kernels and the 
compact support kernels. 

Keywords: Kernel-based approximation (collocation) method; meshfree approximation 
method; high dimension; stochastic partial differential equation; positive definite kernel; Gaus- 
sian field; Levy noise; Poisson noise. 
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1 Introduction 

Recently, stochastic partial differential equations (SPDEs) provide a quantitative description 
for a lot of mathematical models in areas such as physics, engineering, biology, geography and 
finance. Many specialists exert a strong interest in SPDEs and develop their mathematical theories 
and analytical techniques. However, it is a difficult target to obtain the analytical solutions of SPDEs. 
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Thus, how to estimate the numerical solutions of SPDEs becomes a fast growing research area. 
A lot of modern numerical tools are devised to solve SPDEs such as the stochastic collocation 
method 1 2 1 , the Ito Taylor expansions method |T7l and the finite element method combining with 
Monte Carlo and Quasi-Mote Carlo method [18|. But there are still great many unsolved problems 
of the numerical solutions of SPDEs. 

The books 101 |7l |25l show that the kernel-based approximation method to solve deterministic 
high-dimensional PDEs, and moreover, this method can be also applied into the stochastic models 
mentioned in |[3l |23|. It offers us a new idea to apply the kernel-based approximation method 
(kernel-based collocation method, meshfree approximation method) to obtain numerical solutions 
of high-dimensional SPDEs given in our recent paper and doctoral thesis [5, 26 1. Its approximate 
basis induced by the positive definite kernel (reproducing kernel) is different from the polynomial 
basis of the finite element method, which means that the construction of the kernel basis does not 
need an underlying triangular mesh. Furthermore, the data points can be flexibly chosen for the use 
of either deterministic or random design, e.g., Halton points or Sobol points. 

After the discussions of this fresh numerical method with many mathematicians and engineers, 
we determine to renew and improve the analytical results and numerical algorithms of our previous 
papers by their nice and helpful suggestions. We want to let this numerical tool for SPDEs be 
well readable in the interdisciplinary fields of both computational mathematics and statistics. In 
Section|2] we extend [Theorem 3.1, L5|] and [Theorem 7.2, ||261 1 into Theorem |2.1| such that we can 
replace integral-type kernels by more general positive definite kernels to construct Gaussian fields 
in the classical L2-based Sobolev spaces instead of the reproducing kernel Hilbert spaces. We will 
employ these Gaussian fields to introduce the kernel-based approximate solutions of SPDEs similar 
as the techniques of ||21|26l. Their approximate kernel bases are set up by the positive definite 
kernels with the related differential and boundary operators defined as in the equation (2^), and 
the covariance matrixes of the Gaussian fields at the collocation points given in the formula ( |2.3| ) 
are used to compute their expansion random coefficients. The blocks of the covariance matrixes 
are corresponding to the pairwise of collocation points. The covariance matrixes can be seen as the 
generalization forms of the traditional kernel-based interpolation matrixes discussed as in ||7ll25]|. 

Section [3] complements the construction processes and the proofs of the kernel-based approxi- 
mation method, and we even give the new kernel-based approximate results for solving a system of 
high-dimensional linear elliptic SPDEs driven by various kinds of right-hand-side random noises, 
which are unsolved in the final remark section of ||5l. The kernel-based approximate solution is 
obtained for fitting the observation values simulated by the elliptic SPDEs. The kernel-based ap- 
proximate solution of the elliptic SPDEs is a linear combination of the kernel basis, and moreover, 
its expansion random coefficients are solved by a random linear system whose random parts are 



simulated by the elliptic SPDEs (see the equations (3.3 3.4[ )). Proposition |3 . 1 1 shows that the errors 
of the kernel-based estimators can be bounded by the fill distances in the probability sense. The fill 
distance denotes the radius of the largest ball which is completely contained in the space domain 
and which does not contain the chosen collocation points. This means that the kernel-based ap- 
proximate solutions are convergent to the exact solutions of the elliptic SPDEs in probabilities and 
distributions. We present more detail of the error analysis for the elliptic SPDEs than in lU, and we 
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discuss the convergent analysis by the knowledge of statistical learning - replacing the maximum 
error bound to the confident interval - in a different way of the classical kernel-based approximation 
method for the deterministic PDEs. 

In Section |4| we use the implicit Euler scheme to discretize the parabolic SPDE driven by time 
and space Levy noises at time in order to transform it to serval elliptic SPDEs at each discretization 
time step. Next we solve these elliptic SPDEs by the kernel-based approximation method. We also 
briefly discuss the convergence of the kernel-based approximate solutions of the parabolic SPDEs 
undone in Q. We will consider many other time-stepping schemes and their convergent rates in our 
future research. The numerical examples for the Sobolev-spline kernels and the compact support 
kernels show that the approximate probability distributions are well-behave for the second-order 



parabolic SPDEs driven by the time and space Poisson noises (see Figure 5.1 1. Since the covariance 
matrixes of the compact support kernels are sparse, we can solve the related linear systems as fast 
as the finite element method. More numerical examples will be posed in the author's personal 
webpage. 

In our next paper, we will use the extended theoretical results given in this article to set up the 
kernel-based estimators for the nonlinear SPDEs driven by Levy noises. 

Remark 1.1. In our previous papers and doctoral thesis of SPDEs, the kernel-based approxima- 
tion method is also called the kernel-based collocation method. But some people may confuse the 
original name with another diff'erent method as stochastic collocation. In the same way as in the 
book Q we recall this numerical method its general name, and moreover, its estimator is said the 
kernel-based approximate solution or the kernel-based solution in this article. The kernel-based ap- 
proximation method, the kernel-based collocation method and the meshfree approximation method 
are the same in all our SPDEs papers. 

1.1 Examples and Algorithms 

We want to make a convenience for the engineers and the computer scientists to understand 
the kernel-based approximation method and avoid its technical details and proofs. In the beginning 



we give a traditional example of the parabolic SPDE ( |4.1[ ) to explain the kernel-based approximate 
processes and algorithms in a simple way. 

Let 2) be a regular bounded open domain of and 'J-("'iD) be a L2-based Sobolev space of 
degree m > d/2. Suppose that Nt is a Poisson noise in 'H'"{D) with the form 

ni 

Nt,x ■■= Y_i ^KtaicMx), xeD, t>0, 
k=i 

where {(pk}"Li £ is an orthonormal subset of L2(2)), is a positive sequence and Nk,t 

are the independent scalar Poisson processes with parameter A> Ofor aWk = 1, . . . , 
We consider the second-order parabolic SPDE driven by Nt 

dUt - AUtdt + ^iUt)dN,, inD, 0<t<T, 
U,^0, ondD, 0<t<T, (1.1) 
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where A := Tjk=i ^ ^ Laplace dilferential operator and O e C^(IR.). Suppose that this parabolic 

SPDE is well-posed and its solution Ut e almost surely such that E \\Ut\\^,„(^^^ < oo. 

The proposed numerical method for solving the SPDE ( |1.1| ) can be described as follows: 

(51) Discretize the SPDE ( |1.1[ ) in time by the implicit Euler scheme at equally space time points, 
i.e., 

Ur, - Ut,_, = AU,,6t + <I>iUt,_,)dN, i=\,...,n, (1.2) 
where 6t := T/n, ti := + 6t and 6N := M, - ~ Nst- Let Pst := I - 6tA. 

(52) We choose a finite collection of predetermined pairwise distinct collocation points 

X£) := {xi,.. .,Xn} £ 2), Xd£, := {xn+i,- ■ ■ ,Xn+m] £ dD, 
and a symmetric positive definite kernel K € C^'"(2) x D) to construct the basis 

kpBX iPst,2K(-,Xl),--- ,Pst,2K{;XN),K{-,XN+\),--- ,K(;XN+M)f (L3) 



and the covariance matrix (interpolating matrix) 

{P/it^P/it7K(Xlr.,Xl,.) 

KpB,A: 



// \N,N / Y 

[PstAPst,2K(Xki,Xic2))j^^ ^^^j [P6t,lK(Xk^,XN+k2)) 

/ \M,N I \M,M 

^ [P6t,2K{XN+h,Xk2))i^^ l^^_^^ [K{XN+ki,XN+k2))i^^ j^^^^ ^ 



(1.4) 



Here Pst,i and Pst,2 mean that we differentiate the kernel function K with respect to its first 
and second arguments, respectively, i.e., PsuiPst,2K{x,y) := Pst,ziPst,ziK{Zi, Z2)\zi=x,z2=y We 
can also compute that P5t,\P6t,2K{x,y) = K{x, y) - dtAiK{x, y) - dtA2K{x, y)+6f- A\A2K{x, y) 
and PsaK{y,x) = Pst.2K{x,y) - K{x,y) - 6tA2K{x,y). 

(S3) Because the white noise increment 6N at each time instance is independent of the solution 
Utj_^ . The noise term ^ :- 6N ~ Nst is well-defined and we can simulate ^ at Xj), i.e., 

ni 

^xj ■= ^ Ckak<Pk{Xj), j =\,...,N, 4 ~ i.i.d. Poisson(/l(50, k^\,...,ni. 

k=i 



Let r(v, w) := v-i-wO(v) for v, w € R. Combing the equation ( |1.2[ ) with the Dirichlet boundary 
condition we obtain the elliptic SPDE 

lPstu' = nf,a in 2), ^^^^ 
u' = 0, on dD, 

where u' := Ut^ is seen as an unknown part, and /' := Utj_^ and ^ are viewed as given parts. 



The kernel-based solution of the SPDE ( 1 .5 1 can be written as 



N M 



u\x) := ^ CkPst,2K{x, Xk) + ^ bkK{x, XN+k), xeD, 
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and its random expansion coefficients c := {c\, ■ ■ ■ ,Cf^Y ^^id ^ •= (^i' ' ' ' ^^m)^ are com- 
puted by the random linear equation 

Kpb,a: 







where := (r(/(A:i),^,,), • • • ,r(/W,^.jf ■ 

This means that Ut^^Xj is approximated by u\Xj) for all 7 = \,. . .,N. 

(S4) Repeat (S3) for all /= 1, ... , n. 

We can also create an algorithm to obtain the sample paths of the SPDE ( |1.1| ): 
INITIALIZE 



• ^PB,x and KpB,x are given in the equations ( 1.3 1 and ( 1.4 1 for 5t := T jn. 

• u^^ := (mo(jci), • • • , uo{xn))^ e R-'^. 

REPEAT/ - l,...,n 

• Simulate ~ i.i.d.Poisson(/l50 for all ^ = 1, . . . , «/. 

• &j ■= Zti ^kakMXj) for all 7 - 1, ... , A^. 



T 

€ 



. a' := ApB,x ^^^J'^j € R^. 

2 Constructing Gaussian Fields by Positive Definite Kernels with Dif- 
ferential and Boundary Operators 

In this section we want to extend the theoretical results of the integral-type kernels and the re- 
lated reproducing kernel Hilbert spaces given in [Lemma 2.2 and Theorem 3.1, O] and [Lemma 7. 1 
and Theorem 7.2, [26 1] so that we can apply many various kinds of the positive definite kernels and 
the related Sobolev spaces to create Gaussian fields. These Gaussian fields and positive definite 
kernels are used to introduce the kernel-based solutions of SPDEs in the following sections. 

Definition 2.1 ([Definition 6.24, ||25l]). A continuous symmetric kernel K : Dx D ^ Ris called 
positive definite on G Q if, for all A'^ e N and all sets of pairwise distinct centers :- 
{x\, . . . ,xn} Q "D, the quadratic form 

N N 

2 2 CjCkKixj, Xk) = c^Kx^c > 0, for all c e {0} , 

;=i k=i 
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which is equivalent to the matrix K^^, '■= {K(x j,Xk))^'^i is positive definite. 

Let 7Y'"(£)) be the L2-based Sobolev space of degree m > d/2 defined as in Section |A] and 
S CK™(2))) be the Borel cr-algebra on 'J-{'"{D). Suppose that D is a. regular bounded open do- 
main of K.'^ for d € N, and the symmetric kernel function A' is a positive definite kernel on D. 



Further suppose that K e C^'"(2) x D). According to the discussions in Section |b| the kernel 
function K has the positive eigenvalues {/ln),'^i and the continuous eigenfunctions {e,il,7=i such that 
jT^ K{x,y)en{y)dy - A„e„{x) and it possesses the absolutely and uniformly convergent representa- 
tion 

oo 

K{x,y) ^ ^nen{x)en(y), x,y eD. 

n=l 

For simplifying the notations, we denote 

PiP2K{x,y) ■- Pz,Pz,K{zv,Z2)\z,=:c,z2=y^ ByB2K{x,y) := Bz,Bz^K{zi,Z2)\z,=^,z2=y, 



for the linear differential and boundary operators P and B denoted in the equations (A. 1 A.2 1. Here 
Pi , B\ and P2, B2 mean that we differentiate the kernel function K with respect to its first and second 
arguments, respectively. 

The Kolmogorov's extension theorem guarantees the existence of countable independent stan- 
dard normal random variables {^n]'^=i on some probability space To, Pq), i.e., ~ i.i.d.Ar(0, 1). 
Since T,k=i '^n \en{x)^ = K{x, x) < 00 for all x e D, the stochastic process 

00 

^jc{a)) := ^^^„{a))y[A^jen{x), for all jc e D and all a> € Qq, (2.1) 

n=l 

is well-defined on {Q.o,To,'Pq). According to [Theorem A. 19, Ell l. the random variable is 
normal for all x e D. We can also compute the mean E{^x) = E(^„) V^^«(^) = and the 
covariance Cov{^x,^y) - ^i^x^y) - lij^i Var(^„)/l„e„(jir)g„(y) - K{x,y) for all jif,j e D. Therefore 



^ is a Gaussian field with mean and covariance kernel K (see Definition [CTTjI. 

Lemma 2.1. Almost all sample paths of the Gaussian field ^ defined in the formula ( |2.1[ ) belong to 
T{"\D), i.e., X ^j,{aj) e 'J-('"{D)for almost all oj € Qq. 



Proof Denote that ^„ — YJL\ ^kCk- Since K € C2'"(2) x D), we have lim„_,oo^„ ^ ^ in the 



L2 (Oo, To, Po; Loo(D))-norm. We fix any < |a| < m. According to Lemma B. 1 the eigenfunctions 
{en]n=i £ C^^Cl)) c and the convergent representation D^D^/:(jt:,j) = Y.n=\ AnD"en{x)D"en{y) 

is absolute and uniform on x D. Since D is bounded, the map x 1-^ D"D"K{x,x) e Li(D) and 
the representation D"D"K{x,x) = \D"en{x)f is also convergent in the Li(D)-norm. Thus, 

the sequence {C^„)^j is a Cauchy sequence in the Hilbert space L2 (Oq, To, Pq; L2(2))) because 

£|£>%,+„2,x dx- 2 At\D"e,,ixfdx^O,. 

when n\,n2 — > 00. This ensures that there exists a ^q, € L2 {Q.o, 'J^o, Po; L2(2))) such that lim„^oo D"^n = 



we can con- 



in the L2 {Q.o, To, Pq; L2(D))-norm. Combining the above results with Lemma A. 1 
elude that f € L2 (ao,?^o,Po;'H'"(D)) which indicates that x ^ e for almost all 

CO e Qo- □ 
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Let "HKinsii)) be the reproducing kernel Hilbert space of a Sobolev spline kernel K^^g with 



degree m and shape parameter 9 = \ defined in Example B.l Since ^K„,e{'D) is equivalent to the 
Sobolev space •K'"(D), the measurable spaces {'J-{k,„,{D),S{1-{k,„ji{3D))) - i1-{"\D),S{1-{"\D))), 
where S{'Hk„,/D)) and S CK'"!!))) are the Borel cr-algebras on •K/f,„,(2)) and 'H"\D). Thus x ^ 
belongs to 'Hk„,/D) = 'H"'iD) for almost all co e Qq. 

Lemma 2.2 (Generalization of [Lemma 2.2, [5]] and [Lemma 7.1, (2611]). Suppose that D is a 
regular bounded open domain ofW^ and the symmetric positive definite kernel K € C^'"{!D X 2)) 
for m > d/2. Then, for any fixed ji € 'J-{'"{D), there exists a probability measure defined on the 
measurable space {Qm, T^m) '■- {'H'"{D), S CH'^iD))) such that the stochastic process 

SA(^) ■- aj{x), for allxeD and all co € Q„, - •?/'"(£)), 

is a Gaussian field with mean p and covariance kernel K on the probability space {Q.m, P^)- 



Proof. According to Lemma 2.1 almost all the sample paths of the Gaussian field ^ defined in the 



formula ( |2.1| ) belong to 'HK„g{i)) = 'H'"{D). Lemma C.l provides that the probability measure 
induced by ^ 

P^(A) ■- Po(rkA)), for all A € !B{'HK„,Am - SCN'^m = Tm, 

is well-defined on ('K^,„/£)),S('Hjf„„(D))) = {'H'^{'D),3{'H"\m) - {0.m,Tm), and S has the 
same probability distribution as ^. This shows that 5 is a Gaussian field with mean and covariance 
kernel K on the probability space (n^, T'm, P^)- 

Because of the fact that p € 'K'"(2)), we have p + O,,, = O,,, and p + A eTm^ov all AeTm- We 
can set up the another probability measure P^ by shifting P^ for p, i.e., 

P^(A) := Pf (A - p), for all A e Tm- 

Since E (//(jc) + S ^) = p{x) and CovGu(jt:) + S^,p(y) + Sy) = Coy{S^, S y) - K{x,y) on {Q„^, Tm, Pf) 
for x,y e T), the stochastic process S is a Gaussian field with mean p and covariance kernel K on 
the probability space {0.m, Tm, P^)- □ 



Using Lemma 2.2 we can set up many other kinds of Gaussian fields with respect to differential 



and boundary operators on the above probability space (Q„,, %„, P^)- 

Theorem 2.1 (Generalization of [Theorem 3.1, iH] and [Theorem 7.2, [26.1 1). Suppose that D is 
a regular bounded open domain ofW^ and the symmetric positive definite kernel K e C^"\!D x D) 
for m > d/2. Let P and B be the linear differential and boundary operators of orders 0{P) < m 



and 0(B) < m — \, respectively, (see the equations (A.l A.2\). Then, for any fixed p € C'"(2)), 
there exists a probability measure P^ (independent of P and B) defined on the measurable space 
(Q.m,Tm) ■■= (■7-{'"(D),S('H'"(D))) such that the stochastic processes 

PSx(oj) := Poj(x), for all x € D and all co e = 'J-('"(D), 
BS^co) := Bo(x), for all x e dD and all co e Q„, = 'J-("\D), 

are the Gaussian fields with means Pp, Bp and covariance kernels P1P2K, B1B2K on the probability 
space {Q.m, Tn, P^), respectively. 
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Proof. Denote that S := S - ji where S is the Gaussian field given in Lemma 2.2 Because PS - 
Pji + PS and BS = Bfi + BS . If we can verify that PS and BS are the Gaussian fields with means 
and covariance kernels P1P2K and B1B2K, then the proof is completed. 

Since S is a Gaussian field with mean and covariance kernel K defined on the probability 
space {Q.m,'J^m,^f^), the Karhunen representation theorem provides that S = HJ^j V^^«. where 
the random variables ~ i.i.d.N{0, 1) on (0„,, !7^„, P^). According to Lemma . 



A.l 



PS and BS have 



the representations PS = ZJ^j y^nP^n and BS = V^nBen- Combining the expansions of 



PS and BS with Lemma B.l we can solve the means and covariance kernels of PS and BS , i.e., 



EiPS^) = Y^E i^n) ^nPenix) = 0, E(B5 J = J] E ^nBen{x) = 



n=\ n=\ 

and 



Cov{PS^,PSy) = EiPS^PSy) = Y,yari^n)AnPen{x)Pen(y) - PiP2K{x,y), 

n=\ 

ca 

Cov(BS„BSy) = E{BS,BSy) = J] Var (^„) (a:)B^>„(j) - B,B2K{x,y). 



n=\ 



Since K € C^"\D x D), we have P1P2K e C(D x £)) and B1B2K e C(5D x According to 
the above deductions, we can conclude that PS and BS are Gaussian with means and covariance 
kernels P1P2K and B1B2K, respectively. □ 



Remark 2.1. The construction of Gaussian fields in Theorem 2. 1 is analogous to the form of Wiener 
measure defined on the measurable space (C[0, 00), S(C[0, 00))), called canonical space, such that 
the coordinate mapping process Wtioj) = a>it) is a Brownian motion. Why do we need these kinds 
of Gaussian fields? Because they help us to produce the normal random variables associated to the 
differential and boundary operators of SPDEs and the given collocation points located in the space 
domain and its boundary. Using their joint probability density functions and conditional probability 
density functions, we can obtain the kernel-based solutions to fit the observation values which are 
simulated by the SPDEs. 

We choose any linear differential and boundary operators Pi, P2 and Si, B2 of orders 0(Pi) < 
m, 0{P2) < m and 0{B\) < m - 1, (9(^2 ) < m - \, respectively. In the same manner of the 



proof of Theorem 2.1 we can compute their covariances: Co\{PiS x,P2S y) = P\,\P2,2^{x,y), 
Cov{BiSx,B2Sy) - Bi^iB2,2K{x,y) and CovC^i^^, Bi5^) - PuB^,2K{x,y). 
Next we consider the vector linear differential and boundary operators 

V:={Pu--- ,Pn„f, B:=(Bi,-.. 

composed of the finite Hnear differential and boundary operators of the orders 0(P) < m and 0(B) < 
m - 1 , respectively, where their orders are denoted by 

0(P) ■-m^x[0{Py),--- ,0(Pn,)], (9(B) :=max|(9(Bi),--- ,<9(B„J| 
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Given the pairwise distinct collocation points 



, Xn+m) QdD, X := U X^©, 



we can use the Gaussian fields PiS, . . . ,Pn S and B[S, . . . , B„.S to create the related multi-normal 



vector 



(2.2) 



Sph,x '■- 

on {O-m, Tm-, ^P^) by Theorem |2.l[ where 

Pi^Xb \P\^ x\ ? ■ ■ ■ > PnpS xi ) ■ ■ ■ ? PlS ■ ■ ■ 5 P/ipS , 

^^XoB •- (^l-^xjv+i ' ■ ■ ■ ^ J^flbS Xn+1^' " ^ J^lS Xn+M^" ' ^^ni,SxN+M) ■ 

The mean and covariance matrix of 5pb,x can be computed by the same method as above. 

Corollary 2.1. The multi-normal vector 5pb,z given in the equation \2.2\ defined on the probability 
space iflm, 'Fm-, IP^) l^CLS the mean 

/^PB,X := • • • . Pn„ll{X\), ■■■ , BijuiXN+M), ■■■ , Bn,,^l{XN+M)f , 

and the covariance matrix 



K 



PB,X 



(KBp(XAf+/ti , -«^<:2))yt,'i2 = l 



(KBB(-«^A'+/tp-«^A'+/t2)) 



ki,k2=l 
MM 

k\,k2=\) 



(2.3) 



where 



Kpv{Xki,Xk2) := (P;,,l/'y2,2^(-l^yti,-"^<:2))"|"2'=l ' 
^SR{XN^ki,XN+k2) '■- {Bji,lBp_^2K{XN+ki,XN+k2))j 
^PB{Xki,XN+k2) = ^BP{XN+ki,Xk2V ■- [Pj,,lBp_^2K{Xkt,XN+k2))j^ j. 



\nb,nb 
/lj2=l ' 



We let the linear operator L be a differential operator P of order 0{P) < m or a boundary 
operator B of order 0(B) < m - I, i.e., L := P or L := B. We fix any data point x e D or x e dD 
corresponding to the operator L, i.e., when L - P then jc e D, or when L = B then x e dD. Since 
Theorem |2. 1 1 shows that the random variable LS x and the random vector 5pb,x are both normal on 
{Q.m,'^m,^f^), the conditional probability density function /j^^ iSpbx*- ' ^'^ ^ given 5pb,x has the 
the explicit form ,„ (v\v)-p't^ „ (v,v)/r/i (v), where „ and are the joint 
probability density functions of (LS x,Sps,x) and 5pB,x- 

Corollary 2.2. The conditional probability density fiinction of the random variable LSx given the 
random vector 5pB,x defined on the probability space {Q.m, fm, P^) ( discussed as in the above para- 
graph) has the form 

\2\ 



1 



o-L,PB,xix) yln 



exp 



m 



L,x,PB,X 



(V)) 



2o-L,PB.xix)'^ 



(2.4) 
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/or V € R and v € with the mean 

and the variance 

o-L,PB,jfW^ ■= LiL2K{x,x) - ki^v^^xixf^p^j^kiv^^xix), (2.5) 
where k^v^^xix) := L^k¥^^x{z)\z=x and 

km,x{x) ■= [P\,2K{X,Xi),--- ,Pn,„2Kix,Xi),--- ,Bi^2Kix,XN+M),--- ,Bn^2K{X,XN+M)f ■ (2-6) 



(Here fipsx and KpB,x are the mean and covariance matrix of Sf^jc solved in Corollary \2.1\ ) In 
particular, for the given observation values v e ^"p^+'^bM^ probability density function of LS ^ 
given 5pB,x - v is equal to j/^^ \Spbx^'^^^' 

Since the covariance matrix KpB,x is always semi-positive definite, its pseudo-inverse Kpg ^ is 
well-behaved. We observe that A:pB,x is the kernel basis of kernel-based solutions, and the variance 
function crj^p^x^ which is equal to the power function, is used to estimate the error bound. 

According to Theorem |2.1| and Fubini's Theorem we can use the Gaussian field S defined on 
(Q.,„, Tm, IP^) to obtain that 

E|j^ \D''S:c-D"^i{x)[ dx^ = J E\D"Sx-D''fi(x)fdx = J D''^D^Kix,x)dx, 
for all < lal < m which indicates that 

E 



(||5 -//||^,„(25))= 2] r D"^D'^K{x,x)dx. 

\a\<m 

The Markov's inequality provides that 

ETUIS' ~ A'll<;^m(2))) 



P^;.(||5-//||^„,(a)>r)< 



According to the construction of the Gaussian field S defined on = we can introduce 

the following corollary. 



Corollary 2.3. Suppose that the probability space {D.m,'Fm^ P^) defined same as in Lemma 
any r > 0, the subsets 

■- [ueam= : \\oj - //||^,„(s) > r) , 

have the probabilities 



2.2 



For 
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3 Solving Elliptic Stochastic Partial Differential Equations 



In this section, we employ the similar techniques as in |l5l [121 El |26l to introduce the kernel- 
based solutions of the elliptic SPDEs and their convergent rates. 

Let T) be regular bounded open domain of W^, m > d/2 and the vector linear differential and 

T T 

boundary operators P := (Pi,-- - ,P„p) and B :- (Bi,--- ,5,,^) of the orders <9(P) < m and 



(9(B) < m - \, whose elements defined as in the equations (A.l A.2i with the coefficients Ca e 
C'^(.'^-M)(p) and ba e C^^"'-\"^\d'D) are linear independent. Denote that Tj, . . . ,r„^^ e C^{M^) such 
that Fy^/v, -) is bijective for any fixed v € R and 1 < jp < Hp. Suppose that the vector noise 
^ (^1, - - - ,^npf composes of finite independent stochastic processes : D x Q.^, R defined 
on the probability space (O^, Tw, ^w) for jp - \, ... , rip. 

We consider a system of elliptic SPDEs driven by ^ as follow: 



\Piu - ri(/i,^i), . . . , P„^u - Tn„ifn,„U,), in D, 



Biu^gu . . . , Bn^u ^ gn,,, ondD, 



(3.1) 



where /y^ : 2) — > R and gji^ : dD — > R are the deterministic functions for j'^ = I, . . . ,np and 
jt = l,...,nh. 



Suppose that the SPDE (jXTJ is well-posed for its differential and boundary operators. Thus, 
when Piu, . . ., PnU and Byu,..., B„i^u are convergent to the left-hand sides of the SPDE p.l[ ), then 



the estimator u is convergent to the exact solution u of the SPDE p.lj l in the same rate, e.g., the 
maximum principle for the Laplace differential operator gives 

II" - "IIl„(£)) ^- 0{\\M - Am||l„(£)) -I- \\u - uWh^idD)) 

for the heat SPDEs with Dirichlet boundary conditions. (Here the notation means that / = 0(g) if 
there is a positive constant C such that |/| < C |^|.) Further suppose that the solution u belongs to 
the Sobolev space 'H'"{D) almost surely. 

We choose the sets of pairwise distinct collocation points X := X^) U Xq2) from the domain D 
and its boundary dD, i.e., 

X£) := {x\,--- ,xn} £ D, Xq^ := {xn+i,- • ■ ,xn+m} £ dD. 

The fill distance of X for D and dD is denoted by 

hx := max {hxo,v, hxaom] ■ 

where 

:= sup min ||x - x^lb , hx^^m '■= ^^V min llx - Xiv+/t||2 . 

Let P^jpXj) '■ ~^ [0, oo) be the joint probability density functions of the random vectors 
ij,„Xo ■= (^jp,^i ' ■ ■ ■ ' ^Jp^^n)^ for all jp = I,..., rip. Same as the techniques in Section|Dj we can 
be simulated ^^x^, . . .,^n,„Xo their joint probabihty density functions p^^^^^,. ■ ■,P^„p.x^^- Since 
^1 . . . , Xd independent and Tj^{f{xk), -) is a bijective function for any fixed I < k < N 
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and I < ip < Hp, we can use p^,^^, . . . ,p^„^^^^ to obtain the joint probability density function of 
Next we find an appropriate positive definite kernel K : D x D ^ Rto introduce the kernel- 



based solutions of the SPDEs ( |3.1[ ). The covariance matrix Kpb,a: given in the equation p.3| ) (see 
Corollary |2.1| ) will be used to evaluate the coefficients of the kernel-based solutions later. Because 
we need KpB,x to be nonsingular. We suppose that the symmetric positive definite kernel K e 
C^'"(2) X D) satisfies the condition 

ISx o Pj^, 6x,, o Bji^ : Xp e !D, Xb & dD\ . . _ are linearly independent over "K/f (2)), (3.2) 



where 6x is the point evaluation functional at x. According to [Theorem 16.8, 11251 1. the condi- 
tion ( |3.2| ) ensures that all covariance kernels Py^^ jPy^^ 2^ and Bji^^\Bj^2^ positive definite on D 



and dD, respectively, for 7'^ = \,. . . ,np and jh - \, . . . ,ni,. The linearly independent condition p.2| ) 



even indicates that the covariance matrix KpB,z is positive definite. So the inverse of KpB,x exists 
and K^g^ = Kp^^. 

Remark 3.1. |[T0l[m i26l show that that •K^(2)) can contain enough more polynomials. One tech- 
nique to verify the condition p.2| ) is to find a polynomial qx e 'Hxi'D) such that YJk=\ ^]=i c^kP j1x{Xk)+ 



^k=i 2"=i bj,kBjqx{xN+k) = if and only if cij = ■■■ = c„^^n = = ■■■ = = for any 

finite pairwise distinct collocation points X. As a special case, the kernel function K has the form 
K{x,y) := G{x - y) for a positive definite function G € C^'"{W^) and all coefficients of the differ- 



ential and boundary operators of the SPDE ( |3.1[ ) are scalars, then [Corollary 16.12, [25 1] provides 
that the condition p.2|) is always true. 



The main reason of the condition (3.2i is to let the covariance matrix KpB,x be always nonsin- 



gular so that the system of linear equations (3.4 1 is uniquely solvable for any choice of collocation 



points X. This means that the condition p.2|) can be replaced to choose well-distributed collocation 



points X dependent of the differential and boundary operators of the SPDE (3.4 1 such that KpB,x 



is nonsingular. Actually, we may not need the condition p.2| ) to obtain the kernel-based solutions 
because we could solve the linear system < \3.4} by the least square method for the semi-positive def- 
inite matrix Kpb,x- Because we want to employ the theorems of the power functions given in 11711251 
to introduce the convergent rate directly. In this paper we always assume that the kernel function 



K satisfies the condition ( |3.2[ ) in order to avoid the technical discussions and reproof of the similar 
theorems in [7, 25 1. But we can still introduce the similar convergent rate as the techniques of the 
proof of [Theorem 14.4 and 14.5, [7 1] without the condition (|3.2|). 



Since K € C^'"(2) x D), [Theorem 10.45, [25 1] shows that the reproducing kernel Hilbert space 



l-tKi^) £ C'"(D). Using Theorem 2.1 for any fixed ji e 'J-Ik{'D), we can create a probability 
measure on the measurable space {Q.,n,Tm) - ('K'"(D),S('K'" (£)))) such that the stochastic 
processes 

Pj^Sxpicoi) = Pj.coYix) and By^5:,,(oji) = Bj,^coy{x), Xp eD, Xhe dD, oji e 

are the Gaussian fields with means Pj^f^, Bji^ji and covariance kernels P^^^jf 2^. Bj^^^yBji^^^ de- 
fined on the probability space {0.m, %n, IP^). for jp - I,. . . ,np and jb = 1, . . . , 
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Since we have two different kinds of probability spaces (n„,,;f5„,P^) and {Qw,'^w^^w)> it is 
necessary for us to combine them into a new product probability space. We define the tensor product 
probability space 

and let all the original random variables be extended in the natural way: if the random variables 
V\ : Q.m K. and V2 '■ f^w — > R. are defined on (Qm>?^mP^) and {flw,T'w,'^w)^ respectively, then 
their extensions 

X 0J2) := Vi(wi) and V2(wi x 0)2) := V2(w2), for € Q.m and 0)2 £ Hv^. 

The extensions V\ and y2 preserve the original probability distributions, and they are also indepen- 
dent on the product probability space {O-mw, %nw, "^kw^- "^^^^ means that the Gaussian fields induced 
by the chosen positive definite kernels and the noise terms of SPDEs can be extended to the product 
probability space while preserving the original probability distributional properties, and moreover, 
their extensions are independent, e.g., the extensions of the Gaussian field 5(a»i x 0)2) - S{a}\) and 
the noise ^(wi x 0J2) = ^((^2) for wi x 6t»2 e Q.,„w are independent on {D.,mv, Tmw, ^kw^- addition, 
since the solution u of SPDEs can be seen as a mapping from £l„ into 'H'"(D) = Q.m, we have 

U{-, (1)2) € ^mw for all a>2 € 

For any a>i e 'J-{"\D), we let 

PwiCXd) — (PiOJiiXi),--- ,PnpOj(Xi),--- ,PiaJi(XN),--- ,PnpOJl{XN)f, 

Ba>i(Xd£)) := {BiCl>i{xn+i), - ■ ■ , Bn,,a)iixN+i), - ■ ■ , BiaJi{xN+M), - ■ ■ , B„i^a>i{xN+M))^ ■ 
3.1 Constructing Kernel-based Approximate Solutions 



We simulate the observation values of the right-hand side of the SPDE ( |3.1[ ) at the collocation 
points X, i.e., 

yi,i ri(/i(A:i),^i,^i), . . . , yi,N ri(/i(jr/v),^i,;cA,), 



and 



Denote that 



Znb,\ •- 8nb(XN+\), ZtibM '■= gnbiXN+M)- 



^ T 

Z-Xgo '■- (Z\,l, ■ ■ ■ ,Znb,l, ■ ■ ■ ,Zl,M, • • • ,Znt,Mf ^ 



do 
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We let 



^PB.xCy, z) -^{oJi e n„, : PwiCX©) = y and BojiiXdv) = z), 



where the random vector Spb,x induced by the Gaussian fields {PjpS]j''^^ and at the 

collocation points X is defined in the equation ( |2.2| ). 

The approximate probability measure is used to set up the kernel-based solution u to ap- 
proximate the exact solution u of the SPDE p.l| ). Let 

SAv) ■■= {oJi X a>2 € D.mw ■ oJiix) = v] = {oji X W2 e Q.,m, : = v] , 

for V € R and x eT). Using the same techniques as in 1*51(261, the kernel-based approximate solution 
u(x) is a global maximizer of the conditional probability, i.e., 

m(x,W2) :=argmax sup P^^ (£x(v)|:?lpB,z(jf Zb('^2), ZZao)) 

= argmax sup P^^ (Sj^^ v\Spb,x = ,x(w2)) 

veR fie-HKiD) 

= argmax sup p^. .s^^(v\v^^x{oj2)) 

veR tie'HK(D) 

where iSpB^*- ' -' conditional probability density function of the random variable S ^ given 
Sm,x defined on {0.,„^^,,fmw,^f^^r) (see Corollary 2.2 1, and the kernel basis A:pB,x is given in the 
equation ( |2.6| ). Here we can think y^Xo ^^'^ ^'X-ao ^^'^ fixed values to find the approximate mean. 
The kernel-based solution u can be also written as the linear combination of the kernel basis 



N 



M nt 



u{x) ^YuYu Cj^kPj,2K{x, ^/t) + ^ ^ bj^kBj^Kix, XN+k), x e D, 
k=i j=i k=\ j=i 



(3.3) 



and its random expansion coefficients 

c (ci,i,--- 

b := (^1,1,- •• ,bnt,\, 

are solved by the random Unear equations 



\1 

,Cl,N, • • ■ ■<Cn„,N) 



n,M, ■ ■ 



(3.4) 



It is obvious that u satisfies the interpolation conditions at the collocation points almost surely, 
i.e., P\u(xx) = yij,...,PnpU{xN) = ynp,N and Biu{xn+\) = zi,u ■ ■ ■ , B„^ii{xN+M) = Zn^M' and 
moreover, u{-, a>2) £ for all a»2 £ O.^- Because the random part of u{x) is only asso- 

ciated to its random expansion coefficients uniquely solved by the random vector y^Xo ^^'^ 
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deterministic vector Zxgr,- '^^^ formally rewrite u{x,a)2) into u{x,y^Xo^^^dD)- "^^^^ means 
that u{x) can be seen as a random variable defined on the finite-dimensional probability space 
{W^p^ ,S(W'''^),my^^_^) in order that its probability distribution is the same as the original version, 
where the probability measure my^^^{&y) := Py^^_^{y)Ay and Py^,;^ is the joint probability density 
function of j^^^^. 



3.2 Error Analysis 



Now we propose to describe the convergence of the kernel-based solutions. Let x belong to 
D or do corresponded to the linear operator L, which is equal to the differential operator Pj^ for 
1 < jh < nh or the boundary operator Bj^^ for I < jp < rip, i.e., 



when L = Pj^ then x € D,or when L = Bj^ then x e dD. 



jb 



We define 



£L,j:,PB,x(f) := {(^i xaj2 e Q„„,, : \La)i{x) - Lu{x,aj2)\ > e such that 
Pcui(Xo) = j^_Xb(^2) and Bwi(Xa2)) = zxas}, ^ > 0, 
={oji X a»2 e ^mw ■ \LSA(^i) - Luix,aj2)\ > e s.t. 5pb,x(wi) = Vf,x('^2)}, 

where the kernel -based solution u and the observation values v^^ = (y^Xo'^Xao^ induced by the 
linear SPDE p.l| ) are the same as in Section 3J_ 

the conditional mean n?^ ^ pg -^(v) 
has the uni- 



B.l 



We fix any € 'Ka-(D) £ C'"{D). According to Section 
of the conditional probability density function /j^^ iSpbx*- stated in Corollary 
formly representation independent of x, i.e.. 



2.2 



ft'bM 



^Lu{x, y,z) + [h'^~^^^^) , for all 3; e R""^ and all z 
When the fiU distance hx is enough small, then the Chebyshev's inequality provides 
F^l^(£L,.,PB,x(e)) 

= [ A Awi^^^^-^^^'''^^^'\^^p^^x = (y^^z^))'ny,^.Jdy)^z.,jdz) 



-( f f 

Jr'"6** Jr"p" J\v- 

f f 

Jr"**^ Jr"p^ Jr 

-[ ( 

jR"b" Jr", 



\v-Luix,y,z)\>f; 
IJ 

V — m 



L,a:,PB,X 



AcTi PB x{x)^ 



^L5.|SpB,x(^l^' 0')<5zx,a (Z)dvdjdz 

AcTt^p^^xixf 
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where f^zx^^, is the Direct delta function at zxar, ^rid Py^^^ is the joint probability density function of 
y^Xo- Since the variance function o"l,pb,a:(^)^ is equal to the power function ;PpB,xfe ° Q stated 
in Section [B7T| we have 

^KW (£i,A:,PB,x(e)) ^ ^ , when hx is enough small. 

Because \Lu{x,od2) - Lu{x,a)2)\ > e if and only if u{-,oj2) e £L,x,PB,x(f) for all 0)2 £ We can 
find a JCy^ € 2) and a Xji^ € (92) such that 

for all jp = I, ... ,np and jb - \, . . . ,ni,. This indicates that 



ok 



Since the SPDE p.l| ) is well-posed for its differential and boundary operators, we conclude that: 



Proposition 3.1. The kernel-based approximate solution u given in the equations {3.3 3.4 ) is con- 
vergent to the exact solution u of the SPDE ( |3.1[ ) in the probability P^j^/or all p. e 'Hxi'D) when 
the fill distant hx tends to 0, i.e., for any ^ e "HKi^)) and any e > 0, 

0[h"f^) 

^KW (II" ~ "IIl<»(2)) ^ ^) = ^ 0' ^''^'^ 0, 

where £ := max {(9(P),(9(B)}. 

Remark 3.2. More precisely, the convergent rate can be represented as <9(/j^~'^^^) + OQt^^^^q^) 
which indicates that one choice of the optimal designs of and Xqjj has the form h^^^ w 
^x^dTi)' 'Actually the error bounds of the kernel-based estimators can be also described in terms 
of the number N + M of the collocation points X and the dimension d of the domain space 2), 
and moreover, the worse-case errors for some special kernel functions can be even dimension- 
independent and decay as a polynomial in terms ofN + M n?, done in ||8]|9l- 

For the deterministic problem, the maximum eiTor of the kernel-based estimator is bounded 
by the power function. For the stochastic problem, we discuss the convergence of the kernel-based 
estimators by using probability measures, which means that the deterministic error bound is replaced 
by the confidence interval. The confidence interval can be computed by the variance function and 
it is employed to predict the error in the probability sense. The power function and the variance 
function have the same forms but they represent different mathematical meanings. We can also 
obtain the analogous stable error estimate for the both deterministic and stochastic problems. 
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Because the convergence in the probability implies the convergence in the distribution, i.e., F{i(x) 
is pointwise convergent to Fii(x) when hx — > 0, where F[i(x) and Fu(x) are the cumulative distribution 



functions of u(x) and u{x). According to Proposition 3. 1 the distributions of u can be estimated by 
the distributions of u. 



Corollary 3.1. Let u and u be the same as discussed in Proposition 3.1 If G is a continuous and 
bounded function defined on K., then 

lim E{G{u{x))) = E(G{u{x))), xeD. 

hx^O 

In particular, ifE\\u\\^ ^^-^ < oo, then 

lim E{u(x)) - E{u{x)), lim Variu{x)) - Var(u(x)), x eD. 

4 Solving Parabolic Stochastic Partial Differential Equations 

Let 2) be a regular bounded open domain of W^, and X be a Levy process in the Sobolev space 
l-C'XD) for m > d/2 defined on the probability space (Q^,, Tw, {Tl]t>Q, Pw) with the form 

ni 



■Lux ■■= 2_j -Ck,tak(pk{x), xeD, t>0. 



where {^/tl^Lj £ l-C'iD) is an orthonormal subset of L2(D), {o'/tl^I^j is a positive sequence and 
£,kj are the independent scalar Levy processes with triples (0, 1, Vjt) for all ^ = 1, . . . , such that 
Zt^ j^\z\^ Vkidz) < oo (see lHIISlEa)- When £ is a Wiener process, then X can be constructed 
by infinite countable orthonormal bases and independent standard scalar Brownian motions, e.g., £, 
is a Wiener process in 'K'"(2)) with mean zero and spatial covariance kernel function G given by 
E{£,t,x-Cs,y) - min{f, s]G{x,y). Suppose that the linear differential operator P of order 0{P) < m 
and the linear boundary operators of orders 0{Bj^) < m - 1 for all = I,. . .,nh defined as 



in the equations (A.l A.2i with the coefficients Cq. € c2('"-l«l)(2)) and ba € C^('"-^"^\dD) are linear 



independent. Given an initial condition mq e TY^CD), we consider a parabolic SPDE driven by X 

' dU, = PU,dt + ^{Ut)d£t, in 2), 0<t<T, 

B:Ut = gi{t, ■),..., Bn,^Ur^gn„{t,-), ondD, 0<t<T, (4.1) 

Uq = Mo, 

where O € C^(R) and gj^ : [0, T] x dD — > R are the deterministic functions for jh = \, ... , ny. 

Suppose that the SPDE ( |4TT] ) is well-posed and that its exact solution Ut belongs to l^ii^w, Ti„ Pw; '^'"(2))) 
for all < ? < r such that J|'j E ll?/,!!^,,,^^)) dt < oo. 

We transform the parabolic SPDE into several elliptic SPDEs by the implicit Euler schemes and 
solve these elUptic SPDEs using the kernel-based approximation method as in Section [3] 
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(51) We discretize the equation ( |4.1[ ) by the implicit Euler schemes at time = Iq < ti < ■ ■ ■ < 
tn = T, i.e., 

U„ - Ut,_, = PUt,6ti + ^{Ut,_,)5£i, i=l,...,n, (4.2) 
where 5ti :- ti - ti-\ and 5£.i := Xf, - Xr;_i for all / = 1, • • • , n. 

(52) Because the Levy noise increment ^' := 5£.i at each time instance f,- is independent of the 
solution ?7f,_i. We can view that u' :- Ut^ is an unknown part and /' :- Utj_^ is a given part 
computed at the previous step. The equation ( |4.2| ) together with the corresponding moving 
boundary condition becomes a well-posed elliptic SPDE of the form 



I Sim' = gi{ti, •), . . .,B„y = gn,{ti, •), on dD, 



(4.3) 



where r(v, w) := v + h'O(v) and Pstj .- I - dtiP. 



For solving the SPDE ( |4.3[ ), we select the well-distributed pairwise distinct collocation points 
:= {jci, . . .,xn} c £) and Xqj^ :- {x^+i,- ■ ■ ,xn+m} £ dD. In addition, we simulate the 
noise ^' atX^), i.e., 

m 

k=l 



Next we choose a positive definite kernel K e C^"'{D x D) which satisfies the condition p.2| ) 
related to P^ti and Bi,. . . , Bn^ defined same as in Sectional The kernel-based solution u' of 



the SPDE (4.3 1 is computed by the equations (3.3 3.4), i.e.. 



u\x) := kvuxixfKr^ 



VR,X 



where 



T{f{x,),e,^\ 



\x{f\xN),e.j} 



xeD, 



gl{ti,XN+\) ' 



.gntiti^XN-^M). 



(4.4) 



Here the kernel base A:pB,x and the covariance matrix KpB,x induced by the kernel K with 



P := Psti and B := {B\, ■ ■ ■ , BnJ are defined in the equations p.3| ) and ( |2.6| 
This means that Ut- is approximated by the kernel-based solution u'. 

(S3) Repeat (S2) for all /= 1, ... , n. 



We briefly discuss the convergence of the above algorithm for the SPDE ( |4. 1[ ) similar as done 
in ||26]| . Suppose that the distances of all discretization time steps are equal to dt, and that the 
collocation points X and the positive definite kernel K are chosen to be the same at each time step 
tj. According to Theorem 2.1 we firstly set up a probability measure on the measurable space 
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= {0.m,T,n) for // € 'Hk{1^). In the same ways of Section[3]we define a new 
product probability space such that the extensions of the white noise Wt and the solution Ut of the 
SPDE preserve the original probability distributions in the product probability space, i.e., 



Now we consider the global error bound of the estimator m' defined in the equation ( |4.4[ ) in the 
probability P^w. Because of O € C^(]R.), the Ito formula ||22]| provides the local truncation error 



bound of the implicit Euler scheme in the probability '. 



KW 



, I.e., 



Ut, - Ut,_, - PUt,st - o(Ut,_,)s£i ^ 0{6t-y), 



(4.5) 



for all / = 1, . . . where y > is dependent of the scalar Levy processes Moreover, 
Proposition |3. 1 [ provides the errors for each local elliptic SPDE ( |4.3| ) 



u — u — U{n^ ), I — 1, ... ,n, 
where £ := max {(9(P), <9(B)). Denote the global errors 



(4.6) 



\u\xn)) 



i = I,. . . ,n. 



Combining the both local errors given in the equations ( |4.5| ) and ( |4.6| ), we have 



ApB,X 







+ 0(ft'') + O(/j^-0, i=l,...,n, 



where 



ApB,x :^ (kmA^i)' • • • > *pb,x(-»^w), 0, • • ,0)^ Kpg^. 
By induction we can deduce that 



(/ + A: 



m,x + • • • + 



If 6t = 0{h^) then the spectral radius p of the matrix ApB,x satisfies p < 1 , where p > is dependent 
of and P (see HSl). Thus 



n\\ "KW 



1 -p" 



[0{6ty) + O(/j^"0) ^ when 5t ^ and hx ^ 0. 



This indicates that u\xk) is convergent to Utj^xk in the probability P^j^ when both 5t and hx tend to 
0, foralU - 1,...,A^. 



Remark 4.1. In this paper, we focus mainly on the step (S2) to solve the elliptic SPDE ( |4.3[ ) same as 
in Q. The numerical analysis of deterministic parabolic PDEs for the kernel-based approximation 
method is a delicate and nontrivial question, only recently solved in lITSll . We will address this 
question in the case of many other parabolic SPDEs in our future research. 
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5 Numerical Examples 



Now we do a numerical test for the two-dimensional parabolic SPDE driven by the Poisson 
noises with Dirichlet boundary conditions - a typical case of the SPDE ( |1.1[ ). Let the domain 
£) :^ (0, 1)2 c r2, and the Poisson noise Nt have the form 

M,x Xi ^''^^^''Ta — 1277 sin(/:i7rxi) sinfe^xi), x ^ {xi,X2f e D, 

where Nkik2,t are the independent scalar Poisson process with parameter i > for all k\,k2 - 
1, ■■-,«/■ 

We use this Poisson noise Nt to create the paraboUc SPDE 

'dUt = AUtdt + o-UtdN,, in D, < f < T = 1 
Ut = 0, on 52), (5.1) 

Uo - Mo, 

where cr > and Mo(Jir) := sin(7rA;i) sin(7rA:2) + \ sin(2;r;ci) sin(27rA;2). According to the same algo- 
rithm given in Section |1.1| we can compute the kernel-based solutions of the SPDE ( |5.1[ ) by two 
kinds of positive definite kernels: compact support kernel induced by C^-compact support radial 
basis function 

Kc,e(x,y) ■- {3 + m \\x - Jib + 35^2 _ ^^yij (^^ _ g _ j6 ^ x,yeD, 

and Sobolev-spline kernel induced by C^-Matem function 

Ks,o{^,y) := (3 + 39 \\x - yh + \\x - jlQ exp ( - \\x - y^ ), x,y e D, 

where 9 > and the cutoff function (r)+ := r when r > otherwise (r)+ 0. As collocation 
points we select Halton points X£, in T) and evenly space points Xd£, on dO. Using the kernel- 
based approximation method, we can obtain thousand numerical sample paths u{iOk) ~ U{a>k) for 
k = I,. . .,s = 10, 000 by the algorithm given in Section [TTT] Moreover, we can compute its sample 
means and sample standard deviations by these estimate sample paths, i.e., 



1 1 1 

E{U) « - y u{(^k), Dev(?7) ~ — - V u{oJi) - -Y\ u{(^k) ■ 

^ k=i V /=! V ^ k=i ) 

Observing Figure 5.1 we find that the approximate means and the approximate standard deviations 
for both kernels are symmetric with the line xi = X2 because the time and space Poisson noises Nt 
are symmetric with xi and X2 in space. 

Remark 5.1. In our current numerical experiments, the distribution of collocation points and the 
shape parameter are chosen empirically and based on the authors' experiences. Actually, different 
choices of the shape parameters will affect the convergent rate and the stability of the algorithms. 
The convergent rate will decrease when the shape parameter becomes large, but the algorithm will 
be unstable when the shape parameter becomes small. How to select the best shape parameter is 
still an open problem. We will try to solve this problem using the probability measures of the kernel 
functions in our future research. 
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Figure 5.1: Numerical experiments of the probability distributions for the SPDE ( |5.1| ) for cr = \, 
ni = 10 and /I = 10 by the kernel-based collocation method using X^j-Halton points of A'^ = 81 and 
X^£)-evenly space points of M = 36, time step 6t = 0.00167. 



6 Final Remarks 

In this paper we present how to employ the kernel-based approximation method to estimate the 
numerical solutions of SPDEs driven by the Levy noises. We transform the parabolic SPDE into 
the elliptic SPDE by the implicit Euler time scheme at each time step. The kernel-based solution 
of the elliptic SPDE is a linear combination of the kernel basis with the related differential and 
boundary operators centered at the chosen collocation points. Here we only consider the elliptic 
SPDEs with right-hand-side random noises. Actually, the kernel-based approximation method can 
be even applied into solving the SPDE driven by the random differential and boundary operators as 
done in lfT3l . The main idea of this paper is the same as in our recent paper ||5l but we give the new 
contents and extensions to improve the previous theoretical results as follow: 



We extend [Theorem 3.1, [5]] into Theorem 2.1 in order that we can apply more general 



positive definite kernels to set up the kernel-based approximate solutions of SPDEs instead 
of the integral-type kernels, and we only need to assume that the exact solutions of SPDEs 
belong to the classical Sobolev spaces rather than the reproducing kernel Hilbert spaces. 

We obtain the kernel-based approximate solutions of a system of linear elliptic SPDEs driven 
by various kinds of random noises undone before. 

We complete the discussions of the error analysis of the kernel-based approximation method 
for SPDEs and provide its precise convergent rate in terms of the fill distances (or possible 
the time distances). 
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Comparing the kernel-based approximation method for solving the deterministic and stochastic 
elliptic PDEs similar as in Il23l : 

• The kernel-based solution for the deterministic case is to minimize the reproducing kernel 
norm for interpolating the data values induced by the PDEs, and the kernel-based solution 
for the stochastic case is to maximize the probability conditioned on the observation values 
simulated by the SPDEs. 

• The estimate error is bounded by the power function for the deterministic case, and the confi- 
dent interval is computed by the variance function for the stochastic case, and moreover, the 
formulas of the power function and the variance function are equal when the PDE and the 
SPDE have the same differential and boundary operators. 

We also discuss the side-by-side differences of the kernel-based approximation method and the 
finite element method for the elliptic SPDE stated as in lfT2ll : 

• For the kernel-based approximation method we transfer the original SPDE probability space 
to the tensor product probability space such that the extension of the noise preserves the 
same probability distributions. For the finite element method, we approximate the noise by 
its truncated noise which means that we truncate the original SPDE probability space to the 
finite dimensional probability space. 

• The bases of the kernel-based solution are set up by the positive definite kernels with the dif- 
ferential and boundary operators of the SPDE and the collocation points, while the the bases 
of the finite element solution are the finite element polynomials induced by the triangular 
meshes. 

• We can simulate the noise at the collocation points by its probability structure to compute the 
random coefficients of the kernel-based solution, but we can simulate the random part of the 
finite element solution on the truncated probability space. 

• The convergent rate of the kernel-based solution is only dependent of the fill distances. How- 
ever, the convergent rate of the finite element solution depends on the maximum mesh spacing 
parameter of the triangulation and the truncation dimension of the original probability space. 

In our future work we will try to solve the open problems of the kernel-based approximation 
method for SPDEs: 

• We will solve the kernel-based estimators of the nonlinear elliptic SPDEs based on the theo- 
retical results given in this paper. 

• We will try many other time-stepping schemes to create the kernel-based solutions of the 
parabolic SPDEs, and introduce the precise rates of their convergence. 

• We will design the best choice of the collocation points and the optimal kernel function by 
maximizing the conditional probability measure dependent of the observation values simu- 
lated by the SPDEs analogous as the maximum likelihood estimation method. 
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A Differential and Boundary Operators 



In this section, we review some classical materials of linear differential and boundary operators 
mentioned in |Tl [T6l . 

Let 2) be a regular bounded open domain of R'', e.g., it satisfies the uniform C"' -regularity 
condition which implies the strong local Lipschitz condition and the uniform cone condition. This 
means that D has a regular boundary dD := We call the the partial derivative of order 

a := (au--- ,ad) € 

and denote its degree |Qr| := Zj=i Q^;- The test function space is chosen to be T)(2)) = C|^(D) 
composed of all functions y € C°°{!D) with compact support in D. For any fixed / € \J"'^{iy), if 
there exist a function fa € L'°'^(2)) such that 

r fa{x)y{x)Ax = r f{x)D"y{x)Ax, for all y e D(2)), 

then fa is said the weak derivative D" f of /. The L2-based Sobolev space of degree m e No is 
defined by 

n-l'^iD) ■- [f € lJ°'{n) : D"/ e LjCD), for all < |Qr| < m) , 
equipped with the inner product 

(/,5W(»):=Z r D"f{x)D"g{x)dx, f,ge^'"{D). 

\a\<m 

Because the weak derivative D" can be seen as a linear bounded operator from L2(2)) 
when \a\ < m or a linear bounded operator from 'T-("\D) — > L2(52)) when \a\<m - \ according to 
the boundary trace embedding theorem. In this paper all linear differential and boundary operators 
are the linear combinations of weak derivatives with uniformly continuous coefficients. We define 
that the linear differential operator 

P -Yj ■ ^'"^^^ - '^'"(^) ^ c L2iD), (A.l) 

\a\<m 

for all Ca £ C{D) has the order 

0(P) ■- maxIM : c„ ^ 0) , 

and the linear boundary operator 

B - baD"\92):C'"iD)c'}{"\D)^CidD)cL2{dD), (A.2) 

|a|<m-l 

for all ba e C{dD) has the order 

0{B) ■- max{|Qr| : ba ^ 0} . 
It is easy to check that P and B are linear and bounded. 
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Lemma A.l. Suppose that a sequence {fn}'^^i £ 'J-{'"{D) and a function f := lim„_^oo/n in the 
h2{!D)-norm. If there exist a function fa € L2(D) such that lim„-^co D"f„ - fa in the L2{D)-norm 
for any fixed < |ar| < m, then f € This indicates that Pf - lim„^oo Pfn in the L2(D)- 

norm and Bf - lim„_^oo Bf„ in the L2{d!D)-normfor any differential and boundary operators P and 
B of orders 0{P) < m andO{B) <m—\, respectively. 

Proof. Fixing < |Qr| < m, we have 

r fa{x)y{x)Ax = \im f D" fn{x)y{x)Ax = \im f f„{x)D"y{x)dx 

=(-1)'"' r f(x)D"y{x)dx, for all 7 € D(2)), 

which shows that fa is equal to the weak derivative D"f of /. Therefore / e and / = 

lim„_»oo fn in the 'K'"(-2))-norm. □ 



B Reproducing Kernels and Reproducing Kernel Hilbert Spaces 

Most of the detail presented in this section can be found in the monograph 10 |221- For the 
reader's convenience we repeat here what is essential to the kernel-based approximation method. 

Definition B.l ([Definition 10.1, iSl]). A Hilbert space consisting of functions / : D c 

R'' ^ R is called a reproducing kernel Hilbert space and a kernel function ^ : 2) x 2) ^ R is called 
a reproducing kernel for "HKii)) if 

(i) K(;y) € ^k{D) and (ii) f{y) = (/, ^(s , 

for all / € 'T-Ik{'D) and j € D, where (•, •)'Hk{T)) is used to denote the inner product of 'HKi^))- 



According to [Theorem 10.4, 11251 1 the reproducing kernel K is always semi-positive definite. 
Moreover, [Theorem 10.10, f25l] guarantees the existence of the reproducing kernel Hilbert space 
with the positive definite kernel K. 

Suppose that the symmetric positive definite kernel K € C(D x D) and D is a regular bounded 
open domain of R''. Since D is compact, the Mercer's theorem shows that there exists a countable 
set of positive eigenvalues Ai > A2 > ■ ■ ■ > and continuous eigenfunctions £ L2(2)) such 

that j^K{x,y)en(y)dy - and the kernel K has the absolutely and uniformly convergent 

representation K(x,y) = A„en{x)en{y). Furthermore, {en}'^^^ is an orthonormal basis of L2(D) 
and Y.n=Y K<°°- 



Lemma B.l. If the symmetric positive definite kernel K € C^'"(2) x D), then its eigenfunctions 
{cn} £ C^'"(D). Moreover, the convergent representations PiP2K{x,y) = A„Pef,{x)Pen(y) and 
B\B2K{x,y) = ■^nBe„{x)Ben(y) are absolute and uniform on Dx D and dD x dD for any 
differential and boundary operators P and B of orders 0{P) < m and 0(B) < m - I defined as in 



Equations {A.l A. 2), respectively. 
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Proof. Because oiKe C^^CD x D), 

^"""n = -T { DlK{;y)e„{y)Ay € C(^), « e N, 
for any < |Qr| < 2m. This indicates that the convergent representation 

oo 

D",D'^K{x,y) = Y,^nD"en{x)D"eniy) 

n=l 

is absolute and uniform onDx D for any < \a\ < m. □ 

Now we show a special class of reproducing kernels whose reproducing kernel Hilbert spaces 
are equivalent to the Sobolev spaces. 

Example B.l ([Example 5.7, fW{] and [Example 4.4, |[26l l). We consider the Matern function of 
degree m > d/2 and shape parameter 9 > 

where 1 1-> Ky{t) is the modified Bessel function of the second kind of order v. 

According to the theoretical results given in iflOl |26| . we can check that the Sobolev spline 
kernel induced by the Matern function Gm,e 

K,nfi{x,y) := Gmfi{x - y), x,y e R'', 

is a positive definite kernel on R'' and its reproducing kernel Hilbert space "Hx^gi^'') is equivalent 
to the Sobolev space 'K'"(R''), i.e., 

•Kj,,„/R^) - •K'CR^). 

Let D be a regular domain of R'^. According to [Theorem 6, Q], the reproducing kernel Hilbert 
space 'T-(K,„g{'D) of the Sobolev spline kernel Kmfi restricted on D is endowed with the reproduction 
norm 

and it is also equivalent to the Sobolev space 'J-C'iD), i.e.. 

The papers |[T0l[mi26]| also show many other general kinds of reproducing kernels and their re- 
lated reproducing kernel Hilbert spaces are introduced by Green functions and generalized Sobolev 
spaces. 



25 



B.l Power Functions 



Let Pi, . . . ,Pnp be linear differential operators of orders no more than m, whose coefficients 
Ca e C^^"^~^"^\'D), and Bi, . . . ,Bn,, be linear boundary operators of orders no more than m - 1, 
whose coefficients € C^^'""!"'!^^^)). Denote that P := (Pi, • ■ • , Pn^f and B := (Bj, • • • , Bn,f . 
We choose the set of pairwise distinct collocation points X = X£)UXg£, from a regular bounded open 
domain D and its boundary dD, i.e., X^ := [xi, - ■ ■ ,Xn} £ 2) and Xg£, := {x^+i, ■ ■ • ,Xn+m} £ dD. 

Suppose that the symmetric positive definite kernel K € C^"\D x D) satisfies the condition p.2[ ) 
related to P and B denoted as in Section [3] According to [Theorem 16.8, ll25l l. 6^ o L belongs to 
the dual space "THKiiy)' of the reproducing kernel Hilbert space TYjf (D), where L is a differential or 
boundary operator of order 0{L) < m and 0{L) < m - I and is the point evaluation functional at 
X e Dor X € dD. 

The power function induced by the positive definite kernel with the differential and boundary 
operators at the collocation points is defined by 

k=i j=i k=i j=i 



'PpB,xiSx° Lf ■= min 



=LiL2K{x,x) - kL,pB,xixf^prixf^L,PBji{x), 



where the matrix KpB,x and the vector ki p^ xix) are denoted in the equations < \2.3} and ( |2.6| ) respec- 
tively. We can observe that the power function PpB,x (^x ° L) is equal to the formula of the variance 



CL,PB,xix) defined in the equation p.5| ). [Theorem 16.1 1, ||25]I 1 provides that 

PpB,x (Sx o L) < min [rp. {6^ o L) , 'Pb„ ,x,r, (^x o L)] . 



I.e., 



As the discussion of [Section 16.3, |E3] vve have 

\Lii{x) - Ls,^{x)\ < rvBx {5. o L) M\<H,(o) , fi e 'H^(£>), 

where s^^x '■= ^pb x^pb x^pb,a: and//pg^ := (P/i(X©)^, B;u(Xa£))^). Combining [Theorem 11.3 
and 16.9, [25J] the power functions can be also bounded by the fill distances of the collocation 
points and Xg^), respectively, 

:= sup min - Jfi:||2 , /zxaB,^© := sup "lin - •'^A'+ztlb , 

xc=£,k=l,....N ^^Qj^k=\,...,M 
m—0(P ) 

rPBA^x o Pj^j < Cp^h^^,^ when xeD, jp = \,...,np, 

where Cp.^ and Cg^^ are the positive constants independent of x. 
Remark B.l. The precise form of the fill distance of dT) is equal to 

PXaB.ao sup min dist^^Cx, jta^+A:) 

;^g52)/:=l,...,M 

using the distance defined on the manifold surface dT). Since the boundary is regular, we have 
PXao,d£i - 0{hxgjj,dv)- For convenience we does not consider the manifold distance in this article. 
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C Gaussian Fields 



In this section we discuss the basic relationship of Gaussian fields and reproducing kernel 
Hilbert spaces given in |[3ll20l. 

Definition C.l ([Definition 3.28, Q]). Let D c W'. A stochastic process S : D x Q ^ R 
is said to be Gaussian with mean /i : 2) — > 1. and covariance kernel K : D x D ^ R on a. 
probability space (0, 9^, P) if, for any pairwise distinct points X^) := {xi, . . . , Xjm} £ 2), the random 
vector Sxo '■= {Sxi , • • • ,Sxn)^ is a multi-normal random variable on (Q., T, P) with mean fXxo ^^'^ 
covariance matrix Kx^, i.e., 

Sxb ~ ^{fixo'^Xo)' 

where //jf^ := (yu(jri), ••• ,n{xN)y and Kx^ [K{Xj,Xk)).^^^. 

Suppose that 'T-Ik{'D) is a reproducing kernel Hilbert space and SCK/s:(2))) is the Borel cr- 
algebra on 'J-{k{D)- Let ^ : DxQ. ^ Rbe a Gaussian field defined on (Q, T, P). If the sample paths 
X 1-^ ^x{oj) belong to for almost all oj e Q., then ^ can be seen as a mapping from Q into 

Lemma C.l ([Theorem 3.91, 0] and [Lemma 2.1, |i20J]). Suppose that ^ : D x D. ^ R is a 
Gaussian field on a probability space {Q., T , P) with almost all sample paths in a reproducing kernel 
Hilbert space 'Ka:(2)). Then the probability measure given by 

P^(A) P(rkA)), for allAeS CK/f(2))) , 

is well-defined on the measurable space {'HKi^)), S CHKi^))) ) such that the stochastic process de- 
fined by 

S x{co) '■= ojix), for all X e D and all a> e 'Hxii^), 

is a Gaussian field on the probability space ("Kif (2)), 3 CHKiD)) , Pf ) and S has the same proba- 
bility distribution as ^, i.e., the both Gaussian fields S and ^ have the same mean and covariance 
kernel. (Here the reproducing kernel K may be difirerent from the covariance kernel.) 



Lemma 



C.l shows that we can transfer the original probability space {Q.,f,¥) into the new 
probability space {'Hxi'D), S {'Hk{.'D)) , P^ ) so that the original Gaussian field ^ has the invariant 
element S defined on the new probability space. 



D Simulation of Random Variables 

For the kernel-based collocation methods, we need to simulate the SPDE noise term ^ : D x 
Q.W — > R defined on the SPDE probability space {Q.w,'Fw,'^w) at the collocation points X^) := 
{xi, - ■ ■ ,X]\/} Q G Q R'^. For example, if the noise ^ is equal to the product of a Poisson random 
variable ^ with parameter A > and a deterministic function : D ^ R, i.e., ^ := i^tp, then 
^Xj ~ Poisson(/l) • (p(Xj) for all 7 = 1 , . . . , A'^, which can be simulated by the Monte Carlo methods 
(see El). 
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Furthermore, we can simulate many other kinds of noises by the Monte Carlo methods if the 
joint probability density function p^^^^ : [0, oo) of the random vector •~ ' ' ' ^^xnY 

is known. If there is an one-to-one function : (0, 1)^ — > such that 



/7^^^(v) = |det(D0-i(v))|, V 



where D^~^(v) is the Jacobian matrix of the inverse of ^ evaluated at v, then we can simulate 
^Xd ~ 4>iUi, - ■ ■ , J/at) by the independent strand uniform random variables Ui,...,Un, i.e., Uk ~ 
i.i.d.Unif(0, 1) for all A: = I,. . .,N. The vector function 4> '■= {<Pi, ■ ■ ■ , ^nV can be computed by 



0i(h) := F^l{u\), u := (mi, • • • , e (0, 1)^, 
02(m) if^^ iuiWm), u e (0, 1)^, 



0jv(«) := |, , (uN\(f>i(u), ■■■ , 0iv-i(H)) , H e (0, 1)^, 

where F^^^ is the cumulative distribution function of and F^^^\^^^{-\(f>\{u)) is the cumulative dis- 
tribution function of given - (f>i{u), etc., i.e., 

I ••• I PfxB(^i'^2,--- ,?iv)d?iv-d?2dvi, 

OO kJ — oo «-/ — oo 

F^jc2\^^ iz2\zi) := — — dv2, 

J-oo • • • J-co /'f^fB Ui ' f2, • • • , fw)df;v • • • df2 



F^.ff\&i,...^.^_S^N\ZU ■ ■ ■ ,ZN-l) ■■= I 



dv 
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